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Best  Approximation  Algorithms: 
A Unified  Approach 


V.  V.  Kovtunets 


Abstract.  A generalization  of  the  Remez  algorithm  is  proposed.  The 
new  approach  uses  differential  properties  of  the  best  approximation  opera- 
tor. The  method  was  developed  for  polynomial  approximation  of  complex- 
value  functions.  In  this  paper  the  convergence  of  algorithm  is  proved  for 
Banach  spaces. 


§1.  Introduction 

Let  us  consider  the  best  approximation  operator 


where  B is  a Banach  space  (complex  in  general),  P„  an  n-dimensional  sub- 
space. Suppose  that  Pn  is  univalent  and  one-side  differentiable  in  any  direc- 
tion [1],  This  assumption  is  valid  when: 

i)  B = C(Q,  R)  Q-compact,  and  Pn  is  a Chebyshev  subspace  (in  particular, 
when  Pn  is  the  subspace  of  algebraic  polynomials  of  degree  less  or  equal 
to  n — 1 [2,9]); 

ii)  B = C(Q,  C),  Q is  finite  set,  and  Pn  is  an  n-dimensional  Chebyshev 
subspace  [3]; 

iii  ) B = Lp,  p > 1,  and  Pn  is  an  n-dimensional  subspace  (R.  Holmes  and 
B.  Kripke). 

Originally  the  differential  properties  of  the  best  approximation  operator  were 
applied  to  the  development  of  algorithms  in  [4,5].  The  goal  was  to  generalize 
the  Remez  algorithm  for  complex- valued  functions.  In  [6]  the  new  best  approx- 
imation algorithm  was  applied  to  the  approximation  of  conformal  mappings 
by  polynomials.  In  [7]  it  was  shown  that  for  real  polynomial  approximation, 
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such  an  approach  generates  exactly  the  Remez  algorithm,  and  a stronger  con- 
vergence theorem  was  proven  using  differentiation  technique.  In  [8,1],  the 
new  approach  was  applied  successfully  to  nonlinear  approximation,  including 
rational  and  generalized  rational  uniform  approximations. 

Here  we  show  that  the  method  is  applicable  to  the  best  approximation 
from  a finite-dimensional  subspace  in  the  arbitrary  Banach  space  if  the  best 
approximation  operator  is  one-sided  differentiable. 

§2.  Description  of  the  Algorithm 

Suppose  that  the  i-th  step  of  the  algorithm  is  performed  to  find  the  best 
approximation  of  the  element  / £ B,  and  that  the  element  Pi  £ Pn  is  found. 
If  ||/  — Pi||  = E[f),  then  the  process  is  finished.  Otherwise  the  inequality 

||/-Pi||>£(/) 

holds,  and  the  next  step  should  be  performed. 

In  order  to  construct  the  next  approximation  Pj+i,  we  construct  an  aux- 
iliary element  & € B such  that  the  equality 

11/ + 5, -Pill  = 11/ -^11  (1) 

holds.  Suppose  the  following  assumptions  are  true: 

Assumption  1.  The  mapping  G = G(f)  :P„-*B,  which  defines  the  auxil- 
iary element  g,  — G(f,  Pi)  is  continuous. 

Assumption  2.  For  all  functionals  x e B*  with  properties  \x(f  — Pi) \ = 
||/  — Pi||,  ||a:||fl-  = 1,  equality  x{gi)  = 0 holds.  Moreover,  for  every  such 
extremal  functional  x,  a weak  neighbourhood  V (x)  C B‘  exists  such  that 

Rey(f  - Pi)y(gi)  >0,  Wye  V(x)  n {z  € B*,  ||z||  - 1}. 

Assumption  3.  For  given  fixed  f the  mapping  D = D(f)  : B — > Pn,  which 
defines  the  derivative  Di  = D{f,gi),  is  continuous. 

These  assumptions  may  be  satisfied  easily  for  real  and  complex  uniform 
approximations  [4,5,7].  When  the  derivative 

dP(f  + (1  — t)gi) 

~ Jj. 

ai  i=+0 

is  calculated  (usually  as  the  solution  of  system  of  linear  algebraic  equations), 
the  next  element  Pt+i  is  computed  as 

Pi+l  = Pi  + tiDi,  (2) 

where  cri  < ti  < Ti,  0 < c = const  < 1,  and  ty  is  the  minimal  value  of  t , for 
which 


Ei(n)  = min {Ei(t)  = ||/  - P,  - t£>i||,0  < t < 1}. 
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§3.  Main  Theorem 

Theorem  1.  For  given  f € B\Pn,  the  sequence  {P,}°2.0  constructed  accord- 
ing to  the  genera]  scheme  (see  the  previous  section ) converges  to  the  element 
P(f)  of  best  approximation  of  f e B. 

Proof:  Let  us  write 

Ei  = \\f-Pil 

Ei(t)  = ||/  + (1  - t)gi  - P(/  + (1  - 

Ei{t)  = ||/  + (1  -t)gi  - Pi-  tDi\\,  (3) 

Ei(t)  = \\f-Pi-tDi\\, 

ai  = -®i(+0), 

E(  = min{£?i(t),0  < t < 1}  = Eifc),  i > 0. 

The  convexity  of  the  function  Ei  (t)  implies 

E'(+0)  < ^(1)  - Et( 0)  = E(f)  - E(f  + 9i)  = E(f)  - ||/  - ^11  < 0. 
Since 


I Ei(t)  - Ei(t) | < ||P(/  + (1  - t)9i)  - Pi  - tDi\\  = o(t),  t - +0, 


the  equality 

E'i(+ 0)  = £'(+ 0) 

holds.  Therefore, 

P'(+0)  < E(f)  -Ei<  0. 

(4) 

Now  we  show  that  there  exists  e > 0 such  that 

p(t\<F  (t\  4-  2*2H-Dill2 
£.(<)<«<)+  n,  _ j,, 

(5) 

for  all  0 < t < e.  Suppose  that  the  last  statement  is  invalid.  Then  there  is  a 
sequence  {£;},  f;  — » +0,  l — * oo,  such  that 


||/  - Pi  - t, A||  > ||/  + (1  - t l)9i  - Pi  - t,Di ||  + « > 1. 

Choosing  a subsequence  if  necessary,  we  may  consider  the  weakly  conver- 
gent sequence  of  functionals  {x;}  C B*,  V/  ||xj||  = 1,  such  that 

!*«(/  -Pi-  *iDi)  | > 11/  + (i  - U)gi  -Pi-  *iA)||  + i > l.  (6) 


Let  Xq  = limj-.oo  x;.  Then  inequality  (6)  implies 
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and  since  ||a;o||  = 1,  we  finally  have 
Hence  in  accordance  with  Assumption  2 


xo{9i)  = 0. 

Since  ||z;||b*  = 1,  it  follows  from  (6)  that 


(7) 


2t2\xi(D  )\2 

| x,(f  -Pi-  UDi)  | > | xi(f  + (1  - U)gi  -P-  t,Di))  | + ■ (6') 

for  l > 1. 

Now  we  temporarily  write 

a = xt(f  -Pi-  tiDi), 
b={  1 - ti)xi(gi), 

. 2t2\xt(Dj)\2  ^ 

II/-  Pi\\ 

Using  this  notation,  the  inequality  (6')  may  be  rewritten  in  the  form 

|a|  > |o  + b\  + s, 

which  implies  |a|  > |a  + b\.  Consequently, 

|a|2  > |a  + 6|2  + 2|a  + 6|s  > |o  + b\2  + 2|a|s. 


Thus, 

|a|2  + |f>|2  + 2Rea6  < |a|2  - 2|o|s, 

and 

2Rea6  < -|6|2  - 2|a|s.  (8) 

Now  we  substitute  the  values  of  a,  6,  s in  (8)  and  obtain 


2R  ext(f  - Pi-  tiDi)xi(gi)(l  - U) 

< -(1  - I2  - 4|  X,{f  -Pi-  UDi 


Since  tt  ->  +0,  xt{f  - Pi-  ->  ||/  - P,\\,  when  l -»  oo,  there  exists 
number  Iq  such  that  inequalities 
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2R exi(f  - Pi)xi(gi) 

< -(1  - ti)\xi(gi)\2  + 2tlRexi(Di)xl(gi ) - 


Att\Xl{f  - Pi-UD^iDi)? 
(l-t,)||/-P,|| 


C + 2tlRexi(Di)xl(gi)  - 2if  |ari(JDi)|2 

= -\\xii9i)  + 2a;;(Dj)|2  < 0 


are  valid  for  all  l > Iq.  Therefore, 


Rex((/  - Pi)xi(gi)  <0,  VI  > Iq- 

But  taking  into  consideration  (7),  we  see  that  this  inequality  contradicts  As- 
sumption 2,  so  (5)  is  proven. 

Since  £,( 0)  = £,(0)  = £,(0),  (5)  implies 

£'(+0)1  < EK+0)  < E(f)  - Ei.  (4') 

Therefore,  in  accordance  with  (2), 


£j(rj)  = min{\\f  - Pi  - t£>j||,0  < t < 1}  < Ei  and  n > 0. 


So 


Ei+i  < Ei. 


Hence  the  sequence  {£;}“0  converges  to  some  value  E*  > E(f),  i.e., 


lim£j  = Et. 


(9) 


From  (2),  (4')  and  convexity  of  £j(t),  it  follows  that 


Ei+i  < Ei  — 


Ei  ~ Ej{r j) 

n 


U<E{-  c(Ei  - Ei(ri)). 


Consequently, 

A Ei  = Ei+ 1 - Ei  > c(Ei  - Eiin)). 
Since  A Ei  — > 0,  also  E,  — Ei(ri)  — > 0,  and 


lim  Ei(ri)  = lim£j  = £,. 


To  complete  the  proof  we  must  show  that 

£*  = £(/)■ 


(9') 
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Suppose  that  this  statement  isn’t  valid,  i.e., 

Et  > E(f).  (10) 

Since  the  subspace  Pn  is  finite-dimensional  and  Assumptions  1 and  3 hold,  the 
subsequence  {Plk } = {Pk}  may  be  chosen  so  that  the  following  limits  exist: 

i)  lim  Pk  = P,\ 

ii)  limgjfc  =gt; 

iii)  lima{fc  = 

iv)  lim Tlk  = t*. 

Prom  Assumption  3 it  follows  that  also 

lim  Dik  = Z), 


exists,  and 

lim ||/  - Pik  - tDik ||  = ||/  -Pt-  tD.\\  (11) 

uniformly  for  t G [0,1].  Equalities  (9)  and  (9’)  imply  that  at  least  one  of 
following  statements 

a,  = lim  a*,,  = 0;  (12) 

or 

r*  = lim  T/t,  = 0 (13) 

is  valid. 

Using  the  assumption  (10)  and  the  scheme  of  the  algorithm,  we  construct 
the  auxiliary  element  g ^ 0 for  the  approximation  P».  Due  to  Assumption  1, 
we  have 

9 . = 9- 

For  the  following  two  convex  functions 


£*(f)  HI/ + (1 -<)<?*- P(/ + (1  - *)s*)ll, 

E.(t)  = \\f-P.-tD.\\, 


where 


D, 


dP(f  + (1  - t)gt) 

j,  |(-+0i 


analogously  to  (4'),  we  obtain  inequalities 


(14) 


E;(+0)  = E't{+ 0)  < E{f)  - E,  < 0 
and  f > 0,  where  r is  a minimal  value  of  t,  for  which 
E*{t)  = min{E*(t),  0 < t < 1}. 
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From  (11),  it  follows  that  r,  = f and  therefore  (13)  is  impossible.  So  (12)  is 
true.  But  (14)  implies  that  there  is  an  integer  ko  such,  that  for  every  k,k  > ko, 
the  inequality 


ah  < 


E{f)  - E, 
2 


<0 


is  valid,  and  therefore 


a*  < 0. 


This  inequality  contradicts  (12).  Hence  assumption  (10)  is  invalid.  The  theo- 
rem is  proven.  □ 


§3.  Applications 

As  was  mentioned  above,  the  proposed  algorithm  may  be  considered  as 
a wide  generalization  of  the  classical  Remez  algorithm.  Applied  to  polyno- 
mial approximations  of  complex-valued  functions,  the  method  generates  an 
algorithm  which  possesses  in  general  a linear  convergence  as  numerical  exper- 
iments show  (see  also  [6]).  For  finite  sets,  the  convergence  of  the  algorithm  is 
quadratical. 

When  applied  to  real  polynomial  approximations,  the  method  generates 
exactly  the  Remez  algorithm  [7].  But  even  in  this  case  an  approach  which 
uses  differential  properties  of  the  best  approximation  operator  allows  better 
estimations  of  convergence. 

Theorem  2.  ([7]).  Let  Pn  be  a n-dimensional  Chebysbev  subspace  in  C [a,  b], 
and  let  A^(u,  x)  be  the  second  difference  of  the  function  u at  the  point  x with 
step  h.  If  the  function  f € C[a,6]\Pn  has  the  best  approximation  P (/)  G Pn 
such  that  the  difference  f — P (/)  possesses  exactly  n + 1 extremal  points 
Xo,  Xi, . . . , xn  and  the  inequality 

\Al(f-P(f),xj)\  > 7 h2,  7 = const,  j = 0,1,..., n 

holds  in  points  Xj,  then  the  Remez  algorithm  for  f converges  quadratically. 

In  [7]  a modified  Remez  algorithm  for  twice  continuously  differentiable 
functions  is  proposed.  A procedure  for  extremal  points  calculation,  using 
differential  properties,  is  developed  to  reduce  the  complexity  of  the  most  com- 
plicated part  of  the  Remez  algorithm. 

This  method  may  be  applied  to  the  best  polynomial  Lp—  approximation. 

References 


1.  Ivashchuk,  Ya.  G.,  Algorithms  of  best  approximation  of  functions  from 
unisolvent  families,  in  Approximation  Theory  and  its  Applications,  Pro- 
ceedings of  the  Int.  Conf.,  dedicated  to  the  memory  of  V.  K.  Dziadyk, 
May,  Kyiv.  Kyiv,  Inst,  of  Mathematics  Publ.,  1999,  26-31,  to  appear. 


262 


V.  V.  Kovtunets 


2.  Kolushov,  A.,  About  differentiability  of  the  operator  of  best  approxima- 
tion, Mat.  Zametki,  29  (1981),  No. 4,  577-596  (Russian);  Engl,  transl.  in 
Math.  Notes  29  (1981). 

3.  Kovtunets,  V.  V.,  Differentiability  of  the  operator  of  best  uniform  ap- 
proximation of  complex-valued  functions,  Soviet  Math.  Dokl.  42  (1991), 
No.  1,  41-44. 

4.  Kovtunets,  V.  V.,  Algorithm  for  computing  the  best  approximation  poly- 
nomial of  the  complex-valued  function,  Issledovaniya  Po  Teorii  Approxi- 
macii  Funkcij  (Researchs  on  Function  Approximation  Theory),  Kiev,  Inst, 
of  Mathematics  Publ.,  1987,  35-42  (Russian). 

5.  Kovtunets,  V.  V.,  Algorithm  for  computing  the  best  approximation  poly- 
nomial of  the  complex- valued  function  on  the  compact  set,  Nekotorye 
Voprosy  Teorii  Priblizheniya  Funkcij  I Ih  Prilozheniya  (Some  Problems 
of  Approximation  theory  and  its  Applications),  Kiev,  Inst,  of  Mathemat- 
ics Publ.,  1988,  71-78  (Russian). 

6.  Kovtunets,  V.  V.,  About  application  of  polynomials  with  the  least  de- 
viation from  zero  to  the  problem  of  conformal  mapping,  Ukr.  Mathem. 
Journal,  41  (1989),  No.  4,  566-567  (Russian). 

7.  Kovtunets,  V.  V.,  Quasi-newtonian  approach  to  the  development  of  al- 
gorithms of  the  best  uniform  approximation,  Volynskiy  Mathem.  Visnyk, 
L’viv  Math.  Society  Publ.,  1 (1994),  14-29.  (Ukrainian) 

8.  Kovtunets,  V.  V.,  The  algorithm  for  the  best  uniform  nonlinear  approxi- 
mation, Approximation  Theory  and  its  Applications,  Proceedings  of  the 
Int.  Conf.,  dedicated  to  the  memory  of  V.  K.  Dziadyk,  May,  Kyiv.  Kyiv, 
Inst,  of  Mathematics  Publ.,  1999,  26-31,  to  appear. 

9.  Kroo,  A.,  Differential  properties  of  the  operator  of  best  approximation, 
Acta  math.  Acad.  sci.  hung.  30  No.  3-4  (1977),  185-203. 

blvrd.  Lesi  Ukrainky  21a,  ap.  17 
Kyiv, 

Ukraine  01133 
ktpScarrier . kiev . ua 


